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Abstract 


We  discuss  a  new  conceptual  framework  for  the  convexification  of 
discrete  optimization  problems,  and  a  general  technique  for  obtaining 
approximations  to  the  convex  hull  of  the  feasible  set.  The  concepts 
come  from  disjunctive  programming  and  the  key  tool  is  a  description  of 
the  convex  hull  of  a  union  of  polyhedra  in  terms  of  a  higher  dimensional 
polyhedron.  Although  this  description  was  known  for  several  years,  only 
recently  was  it  shown  by  Jeroslow  and  Lowe  to  yield  improved  represen¬ 
tations  of  discrete  optimization  problems.  We  express  the  feasible 
set  of  a  discrete  optimization  problem  as  the  intersection  (conjunction) 
of  unions  of  polyhedra,  and  define  an  operation  that  takes  one  such 
expression  into  another,  equivalent  one,  with  fewer  conjuncts.  We  then 
introduce  a  class  of  relaxations  based  on  replacing  each  conjunct  (union 
of  polyhedra)  by  its  convex  hull.  The  strength  of  the  relaxations  in¬ 
creases  as  the  number  of  conjuncts  decreases,  and  the  class  of  relaxa¬ 
tions  forms  a. hierarchy  that  spans  the  spectrum  between  the  common 
linear  programming  relaxation,  and  the  convex  hull  of  the  feasible  set 
itself.  Instances  where  this  approach  presents  advantages  include 
critical  path  problems  in  disjunctive  graphs,  network  synthesis  problems, 
certain  fixed  charge  network  flow  problems,  etc.  We  illustrate-;, the 
approach  on  the  first  of  these  problems,  which  is  a  model  for  machine 
sequencing. 


1.  Introduction 


Most  discrete  optimization  problems  are  solved  by  some  kind  of  enumera- 
tive  procedure.  These  procedures  use  relaxations  of  the  feasible  set,  and 
of  the  subsets  into  which  the  latter  is  broken  up,  in  order  to  derive  bounds 
on  the  objective  function  value  of  these  subsets.  Their  efficiency  depends 
crucially  on  the  strength  of  these  bounds,  which  in  turn  hinges  on  the  strength 
of  the  relaxation  used.  The  most  commonly  used  relaxation  is  the  linear  pro¬ 
gram  obtained  by  removing  the  integrality  conditions,  sometimes  amended  with 
cutting  planes.  However,  some  integer  programming  problems  have  more  than 
one  formulation,  and  the  various  formulations  may  give  rise  to  linear  pro¬ 
gramming  relaxations  of  varying  strengths.  This  was  known  for  a  long  time 
about  the  simple  plant  location  problem,  for  which  the  disaggregation  of 
the  capacity  constraints  involving  the  0-1  variables  produces  a  consider¬ 
ably  stronger  linear  program  than  the  aggregated  one.  To  the  disaggrega¬ 
tion  of  the  capacity  constraints,  Rardin  and  Choe  [11]  have  recently  added 
a  disaggregation  of  the  flow  variables  of  fixed  charge  network  flow  problems, 
either  from  arc  into  path  flows,  or  from  single  commodity  into  multi- 
commodity  flows,  which  often  yields  a  stronger  linear  program  than  the 
one  in  the  original  variables. 

Approaching  the  problem  from  another  standpoint,  that  of  mixed 
integer  representability  of  various  functions  and  sets,  Teroslow  and  Lowe 
[10]  have  recently  shown  how  certain  mixed  integer  formulations  using  a 
larger  number  of  variables  than  the  common  formulation,  give  rise  to  stronger 
linear  programming  relaxations.  Their  approach  essentially  uses  disjunctive 
programming,  and  our  work  is  closely  related  to  theirs. 


Disjunctive  programming  is  optimization  over  disjunctive  sets.  A 
disjunctive  set  is  a  set  defined  by  inequalities  connected  to  each  other  by 
the  operations  of  conjunction  (A,  juxtaposition,  "and")  or  disjunction 
(V,  "or").  Since  inequalities  define  half spaces,  a  disjunctive  set  can  also 
be  viewed  as  a  collection  of  halfspaces  joined  together  by  the  operations  of 
intersection  (fl)  or  union  (U).  A  disjunctive  program  is  then  a  problem 
of  the  form  min{cx|x  e  F},  where  F  is  a  disjunctive  set. 

Any  integer  or  mixed  integer  program  can  be  stated  as  a  disjunctive 
program,  usually  in  more  than  one  way.  Conversely,  any  bounded  disjunctive 
program  can  be  stated  as  a  pure  or  mixed  integer  0-1  program.  This  is  not 
always  true,  though,  of  an  unbounded  disjunctive  program:  the  set 
xj  <  0  7  xj  >  instance,  cannot  be  represented  by  the  use  of  integer 

variables  unless  x^  is  bounded. 

Besides  this  -  not  too  important  -  difference  in  the  domain  of  applica 
bility  of  the  two  problem  classes,  it  is  often  convenient  to  view  integer 
programming  problems  as  disjunctive  programs.  Apart  from  the  fact  that  this 
is  the  most  natural  and  straightforward  way  of  stating  many  problems  in¬ 
volving  logical  conditions  (dichotomies,  implications,  etc.),  the  disjunctive 
programming  approach  seems  to  be  fruitful  both  theoretically  and  practically. 
On  the  theoretical  side,  it  provides  some  neat  structural  characterizations 
which  offer  new  insights.  On  the  practical  side,  it  produces  a  variety  of 
cutting  planes,  including  facets  of  the  convex  hull  of  feasible  points, 
which  are  hard  to  obtain  by  other  means.  In  some  cases,  like  set  covering 
and  partitioning,  these  cutting  planes  have  been  shown  to  be  considerably 
stronger  than  those  derived  by  other  means,  and  have  been  successfully  used 
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in  algorithms.  In  this  paper  we  show  that  disjunctive  programming  also  pro¬ 
vides  strong  relaxations  of  an  integer  program.  For  background  on  disjunc¬ 
tive  programming,  see  the  surveys  [4],  [9],  [12], 

In  this  paper  we  introduce  a  general  framework  in  which  various  linear 
progransning  relaxations  can  be  classified,  ranked,  strengthened  at  a  given 
computational  cost,  and  viewed  from  a  unifying  perspective.  In  fact,  we 
provide  a  family  of  relaxations  of  a  (pure  or  mixed)  integer  0-1  program  (P) 
whose  members  form  a  hierarchy  in  terms  of  their  strength,  or  tightness.  The 
members  of  this  hierarchy  span  the  whole  spectrum  between  the  usual  linear 
programming  relaxation  and  the  convex  hull  of  the  feasible  set  of  (P) .  This 
is  obtained  by  viewing  (P)  as  a  disjunctive  program  and  making  use  of  the 
rich  variety  of  representations  available  for  the  latter.  Our  main  tool 
is  the  operation  of  taking  the  convex  hull  of  various  disjunctive  sets. 

The  paper  is  organized  as  follows.  Section  2  discusses  some  basic 
properties  of  disjunctive  sets  and  their  equivalent  forms,  and  describes 
a  procedure  for  systematically  generating  these  forms  from  each  other. 

Section  3  deals  with  characterizations  of  the  convex  hull  of  a  disjunctive 
set,  and  their  relationship  to  mixed  integer  representations  of  such  a 
set.  Section  4  introduces  the  hull  relaxation  of  a  disjunctive  set,  which 
gives  rise  to  the  hierarchy  of  relaxations  mentioned  earlier.  Section  5 
illustrates  these  concepts  and  procedures  on  the  disjunctive  graph  formula¬ 
tion  of  the  machine  sequencing  problem. 


2.  Disjunctive  Sets  and  Their  Equivalent  Forms 


We  denote  a  halfspace  by 
H+  =  (x  e  ]Rn|ax  >  aQ}, 

where  ae  ]Ra,  aQe]R.  While  the  intersection  of  a  finite  collection  of 
halfspaces,  i.e.,  a  set  of  the  form 

P  -  n  hT  -  tx  srn“|a1x  >  a,  ,  ieM) 
laM  1  "  i0 

is  known  as  a  polyhedron,  we  call  the  union  of  a  finite  collection  of 
halfspaces,  i.e.,  a  set  of  the  form 

D  =  U  Ht  =  [x  e  |  v  (aix  >  a .  ) } , 
ieM  1  ieM  10 

an  elementary  disjunctive  set. 

A  disjunctive  set  F  can  be  expressed  in  many  different  forms,  that 
are  logically  equivalent  and  can  be  obtained  from  each  other  by  considering 
F  as  a  logical  expression  whose  statement  forms  are  inequalities,  and 
applying  the  rules  of  propositional  calculus.  Among  these  equivalent 
forms,  the  two  extreme  ones  are  the  conjunctive  normal  form  (CNF) 

f  =  n  d 

ieT 

where  each  is  an  elementary  disjunction,  and  the  disjunctive  normal 
form  (DNF) 

F  =  UP, 
ieQ  1 

where  each  P 


is  a  polyhedron. 
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The  usual  statement  of  most  discrete  optimization  problems  is  in  the 
form  of  an  intersection  of  elementary  disjunctions,  that  is  in  CNF.  We  give 
a  few  examples. 

The  feasible  set  of  a  mixed  integer  0-1  program,  given  by  the  constraints 


aXx  >  b^  isM;  0  <  x^  <1,  jeN;  x^  <  0V  x^  >1,  jel  c  N; 


is  in  CNF,  and  can  be  written  as  F  =  fl  D.  ,  with  T  =  MU  »,  U  N  U  I  (where 

ieT  1  12 

N1  =  N2  =  an<*  Di  ^e^ne<*  as  Cx|aLx  >  b^}  for  ieM;  (x|x^  >  0}  for  icN^; 
(x|-x^  >  -1}  for  ie^;  and  {x|-x^  >  0  V  x.  >  l]  for  i*I. 

The  DNF  of  the  same  set  is  F  =  U  PQ,  where  P  is  the  set  of  those  x 

Sd  S 

satisfying  aLx  >  b^  ieM;  0  <  x^  <  1,  jeN;  x^  >  1,  jeS;  and  -x^  >  0,  jel\S. 

Similarly,  the  feasible  set  of  a  linear  complementarity  problem  given  by 
aix  +  bV  =  c1,  ieM;  x^  >  0,  y^  >  0,  jeN;  x.  <  0  V  y.  <  0,  jeN; 
is  in  CNF,  and  so  is  the  feasible  set  of  the  machine  sequencing  problem  [1] 


t.  -  t.  >  d. , 

J  i  “  i’ 

(i,j)  e  Z, 

>  0. 

i  €  V, 

t.  -  t.  >  d.  V  t.  -  t.  >  d., 

J  i-i  i  j  “  J* 

(i » j )  >  (j, 

where  each  inequality  of  Z  defines  a  precedence  relation  between  two  jobs, 
and  each  disjunctive  pair  (i,j),  (j,t)  e  W  states  the  condition  that  jobs  i 

and  j  cannot  overlap. 


On  Che  other  hand,  the  feasible  set  of  the  set  covering  problem  de¬ 


fined  by  the  m  X  n  matrix  A  =  (a±  .),  a^sCO.l},  ¥  i,j,  can  be  stated  in 
CNF  either  in  the  same  way  as  shown  for  the  general  mixed  integer  program, 

or  else  by  letting  T  =  M(={l, . . . ,m})  and  F  *  H  D.  ,  with 

ieT 


D.  =  {x|  v  (x.  >  1)},  ieT,  where  N.  =  tj«N|a 
L  -i  J  1 


jeN. 


ij 


problem,  on  the  other  hand,  is  F  =  U  £x|x.  >  1, 

CeC  J 

of  all  covers. 


a  l}.  The  DNF  of  the  same 
jeC},  where  C  is  the  set 


Although  the  CNF  and  the  DNF  are  the  two  extremes  of  the  spectrum  of 
equivalent  forms  of  a  disjunctive  set,  they  share  a  property  not  common  to 
all  forms:  each  of  them  is  an  intersection  of  unions  of  polyhedra.  We  will 
say  that  a  disjunctive  set  that  has  this  property  is  in  regular  form  (RF). 
Thus  the  RF  is 


(2.D  f  =  ns 

jeT  J 


where  for  jeT, 

(2.2)  5 .  =  U  P  ,  P,  a  polyhedron,  ieQ.. 

J  ieQ.  J 


The  CNF  is  the  RF  in  which  every  is  elementary,  i.e.,  every 
polyhedron  Pi  is  a  halfspace.  The  DNF,  on  the  other  hand,  is  the  RF  in  which 
|T|  =  1.  Notice  that  if  F  is  in  the  RF  given  by  (2.1),  (2.2),  each  is  in 


DNF.  A  disjunctive  set  in  the  DNF  (2.2)  will  be  called  improper  if 
Sj  =  P^  for  some  ieQ^  ,  proper  otherwise.  Any  disjunctive  set  such  that 
|t^ |  =  1  is  improper.  is  convex  (and  polyhedral)  if  and  only  if  it  is 
improper. 
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Next  we  define  an  operation  which,  when  applied  to  a  disjunctive  set 
in  RF,  results  in  another  RF  with  one  less  conjuncts,  i.e.,  an  operation 
which  brings  the  disjunctive  set  closer  to  the  DNF.  There  are  several 
advantages  to  having  a  disjunctive  set  in  DNF,  i.e.,  expressed  as  a  union  of 
polyhedra;  beyond  this,  the  motivation  for  the  basic  step  introduced  here 
will  become  clearer  below  when  we  discuss  relaxations  of  disjunctive  sets. 


Theorem  2.1.  Let  F  be  the  disjunctive  set  in  RF  given  by  (2.1),  (2.2). 
Then  F  can  be  brought  to  DNF  by  |t|  -  1  applications  of  the  following  basic 
step,  which  preserves  regularity: 


For  some  k ,JL  e  T,  k  t  L,  bring  PI  to  DNF,  by  replacing  it  with 


(2.3) 


;ki  *  V 


ieQkXQx  j*VQk 


(Pinp.)  j\j(k 


ieQk 


Proof.  First  we  show  that  is  the  DNF  of  SkflS^.  By  the  dis- 
tributivity  of  U  and  fl,  we  have 


=  u  u  (p  n  p . ) . 

isQkjeQi  J 


But  for  every  iQ«  fl  Q^, 

u  (p  np  )  =  p  =  u  (p  np  ), 

j  eQ ^  o  J  o  j  eQ^  J  o 

and  thus  H as  defined  in  (1.3). 

The  set  F  given  by  (2.1),  (2.2)  is  the  intersection  of  |t|  unions  of 
polyhedra.  Every  application  of  the  basic  step  replaces  the  intersection  of 
p  unions  of  polyhedra  (for  some  positive  integer  p)  by  the  intersection  of 
p-1  unions  of  polyhedra.  Regularity  is  thus  preserved,  and  after  |t|  -  1 
basic  steps  F  becomes  a  single  union  of  polyhedra,  i.e.,  is  in  DNF . ,| 
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Remark.  If  for  some  i^eQk,  i.e.»  is  improper,  then 


(2.4)  S 


k  JL 


U  (P,  OP.) 

i 


jeQ,  lo  J 


1£  W 


otherwise  . 


Every  basic  step  reduces  by  one  the  number  of  co  ..'Cts  in  the  RF 
to  which  it  is  applied.  On  the  other  hand,  it  is  also  Interest  to  know 

the  effect  of  a  basic  step  on  the  number  of  polyhedra  w  »  unions  are  the 

conjuncts  of  the  RF.  When  the  basic  step  is  applied  to  pair  of  conjuncts 
S^,  that  are  both  proper  disjunctive  sets,  namely  unions  of  polyhedra 
indexed  by  Qk  and  Q^,  respectively,  then  the  set  resulting  from  the 
basic  step  is  the  union  of  p  polyhedra,  where 


p  *  IQjXQjI  x  lQx\Qki  +  |QknQ, 


This  is  to  be  compared  with  the  number  of  polyhedra  in  the  unions  defining 
Sk  and  S^,  which  is  | Qk |  +  |q^|.  Obviously,  more  often  than  not  a  basic 
step  applied  to  a  pair  of  proper  disjunctive  sets  results  in  an  increase  in 
rho  nnmher  of  polyhedra  whose  union  is  taken.  On  the  other  hand,  when  one 
of  the  two  disjunctive  sets,  say  Sk,  is  improper,  then  SkZ  is  the  union  of 
at  most  as  many  polyhedra  as  S^. 

Given  a  disjunctive  set  in  CNF  with  t  conjuncts,  where  the  i  conjunct 
is  the  union  of  q.^  halfspaces,  and  given  the  same  disjunctive  set  in  DNF ,  as 
the  union  of  q  polyhedra,  we  have  the  bounding  inequality 
q  <  qL  X...X  qt. 

Because  performing  a  basic  step  on  a  pair  Sk>  such  that  Sk  is 

improper,  results  in  a  set  that  is  the  union  of  no  more  polyhedra  than 

is  S  ,  it  is  often  useful  to  carry  out  a  parallel  basic  step,  defined  as 
JL 


follows  : 


I 


For  F  given  by  (2.1),  (2.2),  and  Sk=P.  for  some  iQsQk  (i.e.,  S 

improper),  replace  0  S  by  /  N  S  where  each  S,  .  is  defined  by  (2  4) 

jeT  J  jeT\{k}  kJ  7  ‘ 

Note  that  if  some  of  the  basic  steps  of  Theorem  2.1  are  replaced 

by  parallel  basic  steps,  the  total  number  of  steps  required  to  bring  F  to 
DNF  remains  the  same. 

Next  we  turn  to  the  operation  of  taking  the  convex  hull  of  a  disjunc¬ 
tive  set,  which  plays  a  central  role  in  the  construction  of  the  family  of 
relaxations  that  we  are  about  to  introduce. 

3 •  The  Convex  Hull  of  a  Disjunctive  Set 
We  have  two  characterizations  of  the  convex  hull  of  a  disjunctive  set, 
each  of  which  requires  the  set  to  be  in  DNF.  The  first  one  is  described  by 
the  following  two  theorems. 

Theorem  3.1  [3,  4,  9].  Let 

(3.1)  F  -  U  P  ,  P  -  {x  e  ]Rn(Aix  >  a1},  ieQ, 
ieQ  1  1  ~  o 

where  each  A  is  an.  m  x  n  matrix,  each  a"  is  an  m.- vector,  and  Q  is  an 

1  O  1  9  ^ 

arbitrary  index  set.  Let  Q*  ■*  {ieQ|Pt  ^  0},  and  let 


ax  >  a  for  all  (a, a  )  g  1R  such  that 
—  o  o 


C(Q*)  =  <  xe  H.n  a  =  uLAL,  aQ  <  uLa^,  ieQ*  > 


i  mi  i 

for  some  u  e  IR  ,  u  >0,  ieQ*. 


clconv  F  =  C(Q*) , 


I: 
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For  che  next  Theorem  we  need  a  definition.  An  inequality  ax  >  is 
said  to  define  (or  induce)  a  facet  of  a  polyhedron  P  of  dimension  n,  if 
ax  >  aQ  for  all  xeP,  and  ox  »  for  n  affinely  independent  points  xeP. 

Theorem  3 . 2  [3,  4] .  Let  the  set  F  defined  by  (2.1)  be  full-dimensional, 

and  let  Q  be  finite.  Then  the  inequality  ax  >  aQ,  where  ctQ  t  0,  defines  a 
facet  of  clconv  F  if  and  only  if  a  ^  0  is  a  vertex  of 


' 

.  . 

y  =  ulA  ,  ieQ* 

II 

=#= 

tn 

ye  H 

for  some  u1  >  0,  ieQ* 

such  that  u^a*  >  a 

* 

0  —  0  > 

Analogous  results  are  known  for  the  cases  where  F  is  less  than  full 
dimensional  and/or  aQ  =  0  (see  [3]). 

This  characterization  can  be  used  to  derive  strong  cutting  planes 
whenever  Q  is  small  or,  although  Q  is  large,  the  special  structure  of  the 
polyhedra  P.^  makes  it  easy  to  find  vertices  of  F'  .  Such  cutting  planes  have 
been  derived  in  [2,  4,  5,  7,  12]  and  have  been  successfully  used  to  solve, 
for  instance,  set  covering  [6]  and  set  partitioning  [8]  problems. 

The  second  characterization  expresses  the  convex  hull  of  a  disjunc¬ 
tive  set  as  the  projection  into  TRn  of  a  higher  dimensional  polyhedron. 

It  is  this  second  characterization  that  we  are  going  to  use  extensively 
in  this  paper.  Since  this  result  is  from  an  unpublished  technical  report, 
we  provide  the  proof  here.  As  before,  we  denote  Q*  =  {ieQjPj  /  0}. 

Theorem  3.3  [3].  Let  F  be  given  by  (3.1),  and  let  §(Q*)  be  the  set 
of  all  those  x  s  IRn  such  that  there  exist  vectors  (y*,  ySeIn+\  ieQ*, 
satisfying 


K 


(3.2) 


A'y“  -  a“y~  >  0  ,  ieQ* 

oo~ 


E  y  =  1 
ieQ* 


yQ  >  0  ,  ieQ*. 


cl  conv  F  =  S(Q*). 


Proof.  (i)  We  first  show  that  conv  F£§(Q*).  Let  x  e  conv  F;  then 


x  =  £  z  X 


for  some  points  z  eP  ,  ieQ*,  and  scalars  a.  >  0,  ieQ*,  such  that  E  a.,  *  1. 

ieQ* 

Setting  y*  =  z1^  and  y*  ■  X^,  ieQ*,  we  obtain  a  set  of  vectors  (y^f  y^) , 
ieQ*,  that  together  with  x  satisfy  (3.2);  hence  x  e  5(Q*), 

(ii)  Next  we  show  that  3(Q*)  Cel  conv  F.  Let  x  e  S(Q*)  and  let 

— i  — 

(y  ,  yQ) ,  ieQ*,  be  vectors  that  together  with  x  satisfy  (3.2).  Let 


Qf  =  {ieQ*|y^  >  0}  ,  Q*  =  (ieQ*|^  =  0}. 


For  ieQ*,  y  /yQ  is  a  solution  to  A  x  >  aQ,  i.e.,  (y  /yQ)ePi;  therefore 


+  E  "‘Sk 

jeVi  ksWt  lk 


ii  ik 

for  some  extreme  points  v  and  extreme  direction  vectors  w  of  P  ,  in¬ 
dexed  by  and  W^  respectively,  and  some  scalars  ^  >  0,  jeV^,  v^k  >  0, 
keW,,  satisfying  I  u,  4  -  1.  Setting  n  y^  =  ,  viky£  =  5ifc,  we  obtain 
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71  -  I  vlj9  +  I  „lk3 

j«V.  13  keW.  11C 
1  i 


with  p .  >0,  j cV.  ,  a  .  >0,  keW. ,  and  £  p  =  y1 

3-J  1  IK  “  1  ,  ,,  lj  O 


jeV. 


For  ieQ*,  either  y  =  0,  or  else  y  is  a  nontrivial  solution  to  the 
homogeneous  system  A^y  >  0;  hence 


— i  v  ik 

y  =  E  w  a 

keW. 


ik 


for  some  extreme  direction  vectors  w  of  P  ,  indexed  by  w  ,  and  some  scalars 

v-0'  keV 

Thus  we  have 


with 


x  -  E  y. 
ieQ*  1 


=  £  (  £ 

ieQ*VjeVi 


ii  .  -  ik  N.  , 

v  pii  ,Z  w  °tvJ 

13  keW 


ieQ*'keWi 


ik 

w  a 


ik/ 


=  2  2  v^*^p  2  2  wx^a 

ieQ*  jeVt  iJ  ieQ*  kc»t 


Z  Z  pij  ^  ^o  ** 
ieQ*  jeV.  13  ieQ*  0 


i.e.,  x  is  the  convex  combination  of  finitely  many  points  and  directions 
of  F.  Hence  x  e  cl  conv  F. 

(iii)  Since 


conv  FSS(Q*)  Cel  conv  F 

and  3(Q*)  is  closed,  while  cl  conv  F  is  the  smallest  closed  set  containing 
conv  F,  clearly  §(Q*)  =  cl  conv  F.|| 


In  order  to  use  this  characterization  of  the  convex  hull,  one  needs 


to  know  which  are  nonempty.  This  inconvenience  is  considerably  mitigated 
by  the  fact,  to  be  shown  below,  that  the  information  in  question  becomes 
irrelevant  if  the  systems  ALyL  >  a^  satisfy  a  condition  that  is  often  easy 
to  check.  Let  (3.2)^  be  the  constraint  set  obtained  from  (3.2)  by  substi¬ 
tuting  Q  for  Q*,  and  let  g(Q)  be  the  set  obtained  from  S(Q*)  by  the  same 
substitution.  For  any  polyhedron  P, let  rec  P  denote  the  recession  cone 
of  P,  i.e. , 

rec  P  :=  (y|x  +  XyeP,  ¥  x  e  P,  ¥  X  >  0}. 

If  and  are  sets,  we  denote 

19  19 

S1  +  S2  =  {x|x  =  y  +  y  for  some  y  eS^,  y  eS2}. 

Theorem  3.4.  3(Q)  =  3(Q*)  if  and  only  if 

(3.3)  X - /fye  ®n|Aly  >  0}  S  Z  rec  P  . 

i  eQ\Q*  ieQ*  1 

Proof.  For  ieQ\Q*,  A^y  -  a^y^  >  0,  yQ  >  0  implies  y^  =  0. 

Therefore 

3(Q)  =  ?>(Q*)  +  C, 

where  C  is  the  expression  (union  of  polyhedral  cones)  on  the  lefthand  side 
of  (3.3).  Clearly,  S(Q*)  +  C  =  ~(Q*)  if  and  only  if  C  £  rec  S(Q*).  But  from 
Theorem  3.3, 

rec  S(Q*)  =  rec  cl  conv  F 

=  Z  rec  P  , 
ieQ* 

hence  g(Q)  =  S(Q*)  if  and  only  if  (3.3)  holds.;] 
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Corollary  3.5.  If  for  every  ieQ,  some  subset  of  the  set  of  inequalities 
A1y1  >  a^  defines  a  bounded  nonempty  polyhedron,  then  S(Q)  *  3(Q*)« 

Thus  the  disjunctive  program  minCcxjx  e  F},  where  F  is  given  by 
(3.1),  is  equivalent  to  the  linear  program  min{cx]x  e  S(Q*)}.  Furthermore, 
there  is  a  1-1  correspondence  between  vertices  of  the  polyhedra  P^,  ieQ*, 
and  basic  solutions  of  the  system  (3.2).  More  specifically  [3]: 

(i)  If  x  is  a  vertex  of  P  for  some  ieQ*,  then  the  vector  with 
components  (y1 ,  yS  =  (x,  1),  (y1* ,  y^)  =  (0,  0),  keQx  (i},  together  with  x, 
is  a  basic  solution  of  the  system  (3.2). 

(ii)  If  x  together  with  (y  ,  yQ),  keQ,  is  a  basic  solution  of 
(3.2),  then  (y1,  y*)  =  (x,  1)  for  some  ieQ*,  (yk,  yk)  =  (0,  0)  for  keQ\{i}, 
and  x  is  a  vertex  of  P^. 

Thus  all  basic  solutions  of  the  system  (3.2)  (or  (3.2)^)  satisfy  the 
condition  y*e(0,  l},  ieQ.  On  the  other  hand,  a  solution  of  (3.2)  (or  (3.2)^) 
satisfying  this  condition  need  not  be  basic.  It  is  then  natural  to  ask  the 
question,  what  do  such  solutions  represent?  The  next  theorem  addresses  this 
issue . 

We  denote  by  S^(Q)  the  set  of  those  x  e  ]Rn  for  which  there  exist 
vectors  (y*-,  y*)e!Rn+\  ieQ,  satisfying  the  constraints  of  (3.2)^  and 
the  condition  y^  *  0  or  1,  ieQ;  i.e., 

^(Q):  =  (x  e3(Q)|y*e{0,  1 } ,  ieQ}. 

Theorem  3.6.  Let  F  =  U  P  ,  Q*  =  (ieQjP  +  0},  and  Q**  =  (ieQ*|P.  £  P  , 

ieQ  1  1  1  J 

*  jeQ* \{i}}.  If  F  satisfies 
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(3.4)  rec  =  rec  P  ,  ¥  i,jeQ** 

and 

(3.5)  {y|Aky  >  0}  S  rec  P  ,  ¥  keQ\Q*,  ieQ** 

then 

Sj(Q)  =  F. 


Proof.  With  or  without  (3.4)  and  (3.5),  S^(Q)2F.  Indeed,  if  x  e 

£  ^  Ic  Ic 

for  some  ieQ,  then  x  together  with  the  vectors  (y  ,  yQ)  =  (x,  1),  (y  ,  y  )  * 
(0,  0),  keQ\{i},  satisfies  the  constraints  defining  §^.(Q).  It  remains  to  be 
shown  that  if  (3.4)  and  (3.5)  hold,  S^.(Q)  SF. 

Suppose  (3.4)  and  (3.5)  are  satisfied  and  let  x  e  S^(Q).  Then  there 
exists  keQ**,  Q  '  £  Q**  and  Q  ''  £  Q\Q*,  such  that 


+ 


i  eQ  /  'J  Q  7/ 


t 

y  , 


and  x  together  with  the  vectors  (yk,  1),  (y*-,  0),  ieQ/UQ//  ,  and  (y^ ,  y^)  = 

(0,  0),  j eQ\Q  '  U Q  "  U{k] ,  satisfies  (3.2)^.  But  then  ykeP^  and  y*e  rec  P^ 
for  ieQ7  (from  (3.4))  and  for  ieQw  (from  (3.5)).  Thus  x  e  P^.|| 

While  the  condition  of  Theorem  3.6  is  not  necessary,  it  is  as  weak 
a  sufficient  condition  as  one  can  get  without  breaking  up  Q**  into  further 
subsets,  for  some  of  which  the  equality  in  (3.4)  can  be  weakened  to  inclusion. 

The  essential  fact  about  Theorem  3,6  is  the  following  immediate 
consequence,  which  was  proved  earlier  in  a  different  way  by  Jeroslow  and 
Lowe  [ 10] . 

Corollary  3.7.  If  each  is  nonempty  and  bounded,  then  §^(Q)  =  F. 

Thus  not  only  is  S(Q)  the  convex  hull  of  the  union  of  the  nonempty, 
bounded  polyhedra  P  ,  ieQ,  but  §^(Q)  is  a  valid  mixed-integer  representation 
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of  such  a  union  of  polyhedra.  As  Jeroslow  and  Lowe  [10]  have  recently 
noticed,  this  representation  is  better  than  the  usual  one,  since  its  linear 
programming  relaxation  is  =>(Q),  the  convex  hull  of  the  union,  which  is  often, 
not  true  of  the  usual  representation.  By  the  latter  we  mean  the  representa¬ 
tion  of  F  =  U  P.  as  the  set  AT(Q)  of  those  x  e  satisfying 
ieQ  1  1 


A*x  -  (a1  -  L1)  6  >  L1,  ieQ 

o  i  — 


£5=1 

ieQ 

5^(0,  1}  ,  ieQ  . 

where  each  L1  is  a  lower  bound  (vector)  on  ALx  , 


If  we  denote  by  A(Q)  the  set  obtained  from  A^(Q)  by  relaxing  the 
conditions  6^(0,  1}  to  >  0,  ieQ,  A(Q)  is  not  necessarily  the  convex 
hull  of  F.  In  other  words,  while  S(Q)  =  conv  S^CQ)  whenever  all  are  non¬ 
empty  and  bounded,  for  A  we  only  have  the  relation 

A(Q)  2  conv  A^.(Q) 

which  often  holds  as  strict  inclusion,  as  will  be  illustrated  later. 

We  need  one  more  result  before  introducing  the  family  of  relaxations 

of  a  disjunctive  set.  Namely,  we  want  to  use  Theorem  3.3  to  characterize 

the  convex  hull  of  an  elementary  disjunctive  set. 

Theorem  3.8.  Let  D  =  U  H?  =  [x  elRn|  v  (a^x  >  a._)}.  Then 
-  ieQ  1  ieQ  10 


{IR11  if  D  is  proper 

H*  if  □  is  improper,  with  D  = 


cl  conv  D  = 
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Proof.  If  D  *  for  some  keQ,  cl  conv  D  =  since  is  closed 
and  convex.  Suppose  now  that  0  is  proper,  and  let  x  be  an  arbitrary  but 
fixed  point  in  ]RQ.  From  Theorem  3.3,  x  e  cl  conv  D  if  and  only  if  the 
system 


i  i  i  _  - 

ay  -  a.  y  >0 


Z  y  =  1 
,  ^  o 


y1  >  0 
3  o  — 


has  a  solution.  From  the  Theorem  of  the  Alternative,  this  is  the  case  if 


and  only  if  the  system 


i  i  ^ 

-u  a  +  v 
o 


-  0  ,  icQ 


(3.6) 


i 

u  a. 
o  10 


vq  >  0  ,  ieQ 


vx  -  v  <0 
o 


uq  >  0  ,  isQ, 


where  u^eK,  ieQ,  v  e  R,  and  vela,  has  no  solution, 
o  o 


.+  _ 


Since  D  i3  proper,  there  exists  no  keQ  such  that  ¥  ieQ; 

i  i  i  k  k 

hence  there  exist  no  scalars  u  >0,  ieQ,  such  that  u  a  =  u  a  ,  ¥  ieQ. 

o  —  00  oo 

Thus  (2.6)  has  no  solution  for  any  x,  and  hence  x  e  cl  conv  D  for  all 
x  e  Rn,  i.e.,  cl  conv  D  =  lRn.|| 


The  convex  hull  of  a  proper  elementary  disjunctive  set  is  thus  K  , 
i.e.f  replacing  such  a  set  with  its  convex  hull  is  tantamount  to  throwing 
away  all  the  constraints  that  define  it.  This  of  course  is  not  true  for 
more  general  disjunctive  sets,  as  will  become  clear  soon. 

The  system  (3.2)  which  defines  the  convex  hull  of  a  disjunctive  set 
in  DNF  is  easy  to  write  down,  but  is  unwieldy  when  the  set  Q  is  large;  and 
for  a  mixed  integer  program  whose  feasible  set  F  is  expressed  as  a  disjunc¬ 
tive  set  in  DNF,  Q  tends  to  be  large.  Thus  an  attempt  to  use  Theorem  3.3 
to  generate  the  convex  hull  of  the  feasible  set  is  in  general  not  too 
promising. 

On  the  other  hand,  the  feasible  set  of  most  discrete  optimization 
problems,  when  given  as  a  disjunctive  set  in  CNF,  has  conjuncts  that  are  the 
unions  of  small  numbers  of  halfspaces,  often  only  two.  Performing  some 
basic  steps  one  obtains  a  set  in  RF  whose  conjuncts  are  still  the  unions 
of  small  numbers  of  polyhedra.  Note  that  if  a  disjunctive  set  is  in  the  RF 


given  by  (2.1),  (2.2),  each  conjunct  is  in  DNF;  hence  we  know  how  to  take 
its  convex  hull.  Naturally,  taking  the  convex  hull  of  each  conjunct  is  in 
general  not  going  to  deliver  the  convex  hull  of  the  disjunctive  set,  but  can 
serve  as  a  relaxation  of  the  latter.  This  takes  us  to  the  class  of  relaxa¬ 
tions  announced  at  the  beginning  of  this  paper. 

4.  A  Hierarchv  of  Relaxations  of  a  Disiunctive  Set 


Given  a  disjunctive  set  in  regular  form 

f  =  ns. 


where  each  S  is  a  union  of  polyhedra,  we  define  the  hull- relaxation  of 
F,  denoted  h-rel  F,  as 


.« 
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h-rel  F  :=  fl  cl  conv  S  . . 

jeT  J 

The  hull-relaxation  of  F  is  not  to  be  confused  with  the  convex 
hull  of  F:  its  usefulness  comes  precisely  from  the  fact  that  it  involves 
taking  the  convex  hull  of  each  union  of  polyhedra  before  intersecting  them. 

Next  we  relate  the  hull-relaxation  of  a  disjunctive  set  to  the  usual 
linear  programming  relaxation  of  the  feasible  set  of  a  mixed  integer  program. 
Obviously,  the  hull- relaxation  of  any  disjunctive  set  is  polyhedral,  since 
the  intersection  of  polyhedra  is  a  polyhedron.  Suppose  now  that  we  have  a 
disjunctive  set  in  CNF, 

f  =  n  d  , 

°  j  eT  J 


where  each  is  the  union  of  halfspaces.  Let  T* 
and  denote 


[jeTjDj  is  improper}. 


p  =  n  d 

j  eT*  j 

with  Pq  =  ]R  if  T*  =  0.  PQ  can  be  viewed  as  the  "polyhedral  part"  of  F  , 
i.e.,  the  intersection  of  those  elementary  disjunctive  sets  that  are  halfspaces. 
Lemma  4.1. 

h-rel  F  =  P  . 
o  o 


Proof. 


h-rel(  n  D  , 
jeT 


h-rel(  P  0  (  D.)  , 

V  0  j  eT\T*  J  ' 

-  cl  conv  P  H I  /■\  cl  conv  D.  ■ 
0  XjeT\T* 


by  the  definition  of  the  hull-relaxation.  But  cl  conv  P  =  P  and  from 

o  o 


Theorem  3.6,  cl  conv  =  H  for  all  jeT\T*.  This  yields  the  equality 


stated  in  the  Lemma. j| 

When  the  feasible  set  of  a  (pure  or  mixed  integer)  0-1  program  is 
stated  in  COT  (which  is  the  usual  way  of  stating  it),  T*  is  the  index  set 
of  all  the  conjunctive,  i.e.,  ordinary  linear  constraints,  and  T\T*  is  the 


index  set  of  the  disjunctions  x.  <  0  V  x.  >  1.  Thus  P  is  the  linear  pro- 

j  -  j  -  o 


gramming  feasible  set,  and  the  hull-relaxation  of  a  (pure  or  mixed-integer) 
0-1  program  stated  in  COT  is  identical  to  the  usual  linear  programming 
relaxation. 


The  next  question  we  address  is  what  happens  if  one  applies  the  hull 
relaxation  to  a  disjunctive  set  that  is  not  in  COT.  Specifically,  we  look 
at  the  effect  of  a  basic  step  in  the  sense  of  relating  the  hull-relaxation 
of  the  RF  before  the  basic  step  to  that  of  the  RF  after  the  basic  step. 

Lemma  4,2.  For  j  =  1,  2,  let 


s  =  U  Pt, 

J  ieQj 


where  each  P^,  icQ^,  j  =  1,  2,  is  a  polyhedron.  Then 


(4. 1)  cl  conv(S^  fl  S^)  £  (cl  conv  S^)  D  (cl  conv  S^)  . 


Proof.  Certainly  HS^  c  (cl  conv  S^)  fl  (cl  conv  S2),  and  since 
cl  conv  (St  flS2)  is  the  smallest  closed  convex  set  to  contain  S^flS^,  (4.1) 
follows.  Jl 


Theorem  4.3.  For  i  =  0,  1 


t,  let 
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be  a  sequence  of  regular  forms  of  a  disjuntive  set,  such  that 

(i)  F  is  in  CNF,  with  P  3  fl{S?|S?  is  improper}; 
o  o  J  j 

(ii)  F  is  in  DNF ; 

(iii)  for  i3l,...,t,  F^  is  obtained  from  F^_^  by  a  (possibly 
parallel)  basic  step. 

Then 

P  *  h-rel  F  «  h- rel  F,  2 . . .  a  h-rel  F.  =  cl  conv  F  . 
o  o  1  t  t 

Proof.  The  first  equality  holds  by  Lemma  4.1,  since  Fq  is  in  CNF. 

The  last  equality  holds  by  the  definition  of  a  hull-relaxation,  since  F 
is  in  DNF,  i.e.,  1 T^ )  =  1.  Each  inclusion  holds  by  Lemma  4.2,  since  for 
k  3  l,...,t,  is  obtained  from  Fk_^  by  a  basic  step.|| 

For  any  F^  in  the  above  sequence,  we  can  obtain  from  the  hull-relaxa¬ 
tion  a  mixed-integer  programming  representation  of  F^  by  using  Theorem  3.6. 
However,  this  representation  requires  one  0-1  variable  for  every  polyhedron 
in  the  expression 

(4.2)  F  =  n  s!  ,  sj  =  u  Ph  ,  P  3  {yemnjAhy  >  a]M ,  hcQ  jeT, 

1  j*Tt  J  J  h*Q  031 

which  is  usually  much  more  than  the  number  of  0-1  variables  needed  to 
represent  the  CNF  of  the  same  set,  i.e., 

(4.3)  F  3  n  s°  ,  S°  3  u  H+  . 

0  ret  r  r  seQ  S 

0  r 

The  next  theorem  gives  a  mixed  integer  representation  of  F^  which  uses 

the  same  number  of  variables  as  that  of  F  .  For  F  as  defined  in  (4.3),  let 

0  0 

T^  3  [rcTols°  is  proper}. 


Theorem  4.4.  Let  Fq  be  the  disjunctive  set  in  CNF  given  by  (4.3), 
and  let  be  the  disjunctive  set  in  RF  given  by  (4.2),  obtained  from  Fq 
by  a  sequence  of  basic  steps,  and  satisfying  the  conditions  of  Theorem  3.6, 
Then  F^  is  the  set  of  those  x  e  jRa  for  which  there  exist  vectors  (y\y^)e 
heQj ,  jsTi>  and  scalars  5rg,  s eQr>  reT^,  satisfying 


(4.4) 


(4.5) 


(4.6) 


x  -  E  y 
heQj 


=  0 


h  h  -h  „h  >  Q  V 


Ay-  ay 
o  o 


yh  >  0 
J  o  — 


) 


E  y  ■  1 
heQj  ° 


h  I P  SH+ 
1  h  s 


6  =  0 
rs 


=  5«  =  1  ’ 
seQr 


6„«t0,l} 


reT ' 
o 

s  eQ  ,  r  eT / . 
r  o 


Proof.  From  Theorem 


define  the  convex  hull  of  S. 

J 

heQ^,  they  define  itself. 


3.6,  for  each  j eT^  the  constraints  (4.4) 

,  and  if  amended  with  the  condition  yo«{0,l}, 

We  will  show  that  the  constraints  (4.5),  (4.6) 


enforce  precisely  this  condition,  and  therefore  all  constraints  together 


define  F, 


n  s1. 

j  eT.  J 


K  - 

For  any  given  5  satisfying  (4.6),  the  unique  set  of  yQ  satisfying 


(4.5)  is  defined  by 
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(4.7) 


yo  = 


if  6  =1,  ¥(r,s):H  a?  and  seQ 

rs  *  *  s  h  r 

otherwise. 


Indeed,  6  =0  implies  y  *  0  for  all  heQ.,  jeT.,  such  that 

’  rs  r  J  o  J  i 


*+  -r 


H  SP,  ;  which  means  that  those  constraints  (4.5)  for  which  6  =1  must 

rs  n  rs 

be  satisfied  by  setting  y^  =  1  for  precisely  those  heQ^ ,  jeT^,  for  which 
this  is  prescribed  by  (4.7).  || 

Theorem  4.4  provides  a  way  of  representing  any  disjunctive  set  in 
regular  form  as  the  feasible  set  of  a  mixed-integer  program  with  the  same 
number  of  0-1  variables  as  would  be  required  to  represent  the  same  disjunc¬ 
tive  set  in  CNF. 

In  order  to  make  best  use  of  the  hierarchy  of  relaxations  defined 
in  Theorem  4.3,  one  would  like  to  know  which  basic  steps  result  in  a  strict 
inclusion  as  opposed  to  an  equality.  The  next  theorem  addresses  this  question. 

Theorem  4.5.  For  j  =  1,  2,  let 


S.  -  U  P., 
J  i«Q  1 


where  each  P^  ieQ,  j  =  1,  2,  is  a  polyhedron.  Then 
(4.8)  cl  conv(S^flS2)  =  (cl  conv  S^)  fl  (cl  conv  S_) 


if  and  only  if  every  extreme  point  (extreme  direction)  of  (cl  conv  0 
(cl  conv  S7)  is  an  extreme  point  (extreme  direction)  of  P.  fl  P.  for  some 
(i,  k)eQ1  x  Q2- 

Proof.  Let  TL  and  TR  denote  the  lefthand  side  and  righthand  side, 
respectively,  of  (4.8).  Then 


Tt  =  cl  convi  U  U  (P,  HP.); 
L  "isQ1  keQ, 


Thus  x  s  T  if  and  only  if  there  exist  scalars  \.  >  0, 

L,  1  - 

ie W,  such  that  Z  X.  =  1  and 
jeV  J 


j  eV  and  a  >  0 , 


K ‘  .e„Vj  +  ,z 

j  eV  J  J  It W 


where  V  and  W  are  the  sets  of  extreme  points  and  extreme  direction  vectors, 

respectively,  of  the  union  of  all  0 P  ,  (i,  k) eQ^  X  Q^. 

On  the  other  hand,  x  e  T_  if  and  only  if  there  exist  scalars  X 7  >  0, 

K  J  ~ 

j  eV 7  and  >  0,  It W7,  such  that  Z  X 7  =  1  and 
1  jev7  J 


x  «  E 

jev 


/.  * 
-Vi 


where  V7  and  W7  are  the  sets  of  extreme  points  and  extreme  direction  vectors 

respectively,  of  T^.  If  the  condition  of  the  theorem  holds,  i.e.,  if  V7CV 

and  W 7  C  W,  then  T_  C  T_  ,  and  since  by  (4.1)  T_  iT_,  we  have  T_  =  T_  as 

K  L  L  K  L  R 

claimed.  If,  on  the  other  hand,  VA,V  M  or  W #\W  0,  then  there  exists 

x  e  TR  T^,  hence  (4.1)  holds  as  strict  inclusion. ;| 

One  immediate  consequence  of  this  Theorem  is 
Corollary  4.6.  Let 

K  =  (x  e  ]Rn|0  <  x  <  1,  j  *  1, . . . ,n} , 

and 

Sj  =  t*  e  K|Xj  <  0  v  Xj  >  1},  j  =  1 . n. 


Then 

n  n 

(4.7)  conv  Pi  S.  =  fl  conv  S.. 

j-1  J  j=l  J 

Thus  basic  steps  that  replace  a  set  of  disjunctive  constraints  of 
the  form 


x.  <  0  V  x. 

J  “  J 


>  1, 


jeT 


by  a  disjunctive  constraint  of  the  form 


x.  <  0 

J  ~ 


,  j«S 


‘0 


\  xj  >  v> 


jeT'S 


before  caking  Che  hull -relaxation,  do  noc  produce  a  scronger  relaxacion: 
caking  Che  convex  huJ 1  before  or  af Cer  che  execution  of  such  basic  steps 
produces  che  same  result.  In  order  Co  obcain  a  stronger  hull-relaxation, 
che  basic  steps  to  be  performed  must  involve  some  other  constraints  than 
chose  of  Che  above  form. 

Next  we  illustrate  on  some  examples  various  situations  when  taking 
the  convex  hull  before  or  after  a  basic  step  does  make  a  difference. 


Example  4.1.  (Fig.  3.1)  Let  Pj.  =  {x  e®2^  =  0,  0  <  x?  <  l}, 

P2  =*  {x  e®2|x1  -  1,  0  <  x2  <  1},  P3  =  {x  e®2|-Xl  +  x£  >  0.5,  x  >  0, 

*2  <  1},  P4  -  (x  e®2|Xl  -  x2  >0.5,  xj  <  1,  x2  >0},  and  let  F  =  SjflS  , 
with  Sx  -  P1UP2,  S2  -  P3UP4.  Then 


(cl  conv  S,)  H  (cl  conv  S_) 


cl  COQV  S1  =  {x  s  n2|0  <  Xx  <  1,  0  <  x2  <  1] 

cl  conv  S2  =  [x  eE2|0.5  <x^  +  x2  <  1.5,  0  <  <  1,  0  ^  x2  -  ^ 

and 

(cl  conv  Sx)  H  (cl  conv  S2)  =  cl  conv  S^. 

On  the  other  hand,  Sx  H  S2  =  (Px  UP3>  H  (P  U  P4>  (since  P10P4  * 

P2  flP3  =  0),  and 

cl  conv(S1flS2)  =  {x  e  E2  |l  <  x^  +  2x2  <2,  0  <  <  l}. 

Here  (4.1)  holds  as  strict  inclusion,  because  the  vertices  (0.5,  0) 

and  (0.5,  1)  of  (cl  conv  S)  fl  (cl  conv  S2>  are  not  vertices  of  either  P^flP3 
or  P2flP4,  although  the  first  one  is  a  vertex  of  P^,  and  the  second  one  a 
vertex  of  P^. 

Example  4.2.  (Fig.  3.2)  Let  ?1  =  (x  e  E2  |x1  =  0,  x2  >  0}, 

P2  =  {x  e]R2|x1  =  1,  x2  =  0},  P3  =  {x  eH2|x1  =  0,  x2  =  0}, 

2 

P4  =  {x  el  -  1,  x2  >  0},  and  let  F  =  s1^s2»  with  SL  =  PiUP2* 

S2  =  P3UP4.  Then 


2 

cl  conv  S1  =  cl  conv  S2  =  {x  e E  |0  <  ^  <  1,  x?  >  0 } , 

=  (cl  conv  S^)  Cl  (cl  conv  S2>, 


cl  conv(SinS2>  =  cl  conv(  (P^  U  P3)  -  (P? P^) ) 

=  fx  c  E2  JO  <  x.  <1,  x.  =  0}. 


whereas 
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Here  (4.1)  holds  as  strict  inclusion  because  (0,  1)  is  an  extreme 
direction  vector  of  (cl  conv  S^)  ft  (cl  conv  S^),  but  not  of  P^ftP^  or  P  HP^. 

It  is  an  important  practical  problem  to  identify  typical  situations 
when  it  is  useful  to  perform  some  basic  step,  i.e.,  to  intersect  two  con- 
juncts  of  a  RF  before  taking  their  convex  hull.  The  usefulness  of  such  a 
step  can  be  measured  in  terms  of  the  gain  in  strength  of  the  hull-relaxation 
versus  the  price  one  has  to  pay  in  terms  of  the  increase  in  size.  Since  the 
convex  hull  of  an  elementary  disjunctive  set  is  Hn,  i.e.,  taking  the  convex 
hull  of  such  sets  does  not  constrain  the  problem  at  all,  one  should  inter¬ 
sect  each  elementary  disjunctive  set  in  the  given  RF  with  some  other  con¬ 
junct  Sk  before  taking  the  hull-relaxation.  This  can  be  done  at  no  cost  (in 
terms  of  new  variables)  if  is  improper.  Often  intersecting  a  single  im¬ 
proper  conjunct  with  each  proper  disjunctive  set  appearing  in  the  same 
RF,  i.e.,  executing  a  single  parallel  basic  step  before  taking  the  hull  re¬ 
laxation,  can  substantially  strengthen  the  latter  without  much  increase  in 
problem  size.  As  to  shich  improper  conjunct  to  select,  a  general  principle 
that  one  can  formulate  is  that  the  more  restrictive  is  with  respect  to  each 
Sj,  the  better  suited  it  is  for  the  purpose.  The  next  example  illustrates  this. 

Example  4.3  Consider  the  0-1  program 


(P) 


min 


x1,  x2et0,  l}j 


illustrated  in  Fig.  3.3. 


Figure  3.3 
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The  usual  linear  progranming  relaxation  gives  the  optimal  solution 
x^  =  3  2/5,  with  a  value  of  i  -  6/5.  This  of  course  corresponds  to 

taking  the  hull-relaxation  of  the  CNF  of  the  feasible  set  of  (?) ,  which 
contains  as  conjuncts  the  improper  disjunctive  sets  corresponding  to  each 
of  the  inequalities  of  (P)  (including  0  <  x^  <  1,  0  <  x^  <  1)  and  the 

2 

two  proper  disjunctive  sets  =  {x  e  H  |x^  <  0  V  x^  >  l], 

2 

*  [x  e  1R  |*2  <  0  V  *2  >  1}.  If  Pq  is  the  intersection  of  all  the 

improper  disjunctive  sets,  the  hull  relaxation  of  the  CNF  of  (P)  is 

F  =  P  flconv  S.  fl  conv  S0. 
o  o  1  2 

r\ 

Let  us  write  K  =  [x  e  B  ]0  <  x1  <  1,  0  <  x2  <  l},  and  Pq  -  Pq1  0  Pq2, 

with  Pq1  =  (x  e  Kj-J^  +  x2  >  0},  Pq2  »  £x  e  +  4x2  >  2}.  Now  suppose  we 

intersect  each  of  and  S2  with  Pq1  before  taking  the  convex  hull,  i.e., 

use  the  hull  relaxation  ?x  «  Pq2  H  conv(PQl  fl  n  conv(pQl  0  Sg).  We  find 

that  conv(Pol  C\  S  )  *  conv(PQl  0  S,)  »  [x  e  +  x£  >  0},  and  hence 

F,  =  F  ,  i.e.,  these  particular  basic  steps  bring  no  gain  in  the  strength 
1  o 

of  the  relaxation. 

Suppose  instead  that  we  intersect  and  S2  with  Pq2  before  taking  the 
convex  hull,  i.e.,  use  the  hull  relaxation  F2  =  po1  n  conv(Po2  n  sx)  n 
conv(Po2  H  S2).  Then  conv(PQ2  fl  *  [x  e  +  4x2  >  2},  conv(PQ2  fl  S2) 

>  (x  s  k|x2  =  1},  and  F2  *  £x  «  k|x2  *  l},  which  is  a  stronger  relaxation 
than  F  .  Using  the  relaxation  F-  instead  of  F  ,  i.e.,  solving  min{z  =  -x 

O  fc  O  1 

+  4x2jx  e  F2),  yields  xx  -  S2  ■  1 ,  with  z  -  3,  which  happens  to  be  the 
optimal  solution  of  (P). 

Note  that  Pq^  cuts  off  only  one  vertex  of  conv(S^  H  K)  *  conv(S2  fl  K)  =  K, 

whereas  p  „  cuts  off  two  vertices  of  K.  !j 

o2 
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When  basic  steps  are  used  that  intersect  proper  disjunctive  sets 
before  taking  their  convex  hull,  the  number  of  variables  in  the  hull  relaxa¬ 
tion  increases.  Especially  attractive  are  those  situations  where  the  in¬ 
crease  in  problem  size  is  mitigated  by  the  presence  of  some  structure  that 
makes  it  possible  to  solve  the  increased  linear  programs  efficiently.  This 
is  the  case  in  the  machine  sequencing  problem  discussed  in  the  next  section, 
as  well  as  in  certain  network  synthesis  and  fixed  charge  network  flow  problems. 

5.  An  Illustration:  Machine  Sequencing  via  Disjunctive  Graphs 

In  this  section  we  illustrate  the  concepts  and  methods  discussed  in 
sections  1-4  on  the  example  of  the  following  well  known  job  shop  scheduling 
(machine  sequencing)  problem:  n  operations  are  to  be  performed  on  different 
items  using  a  set  of  machines,  where  the  duration  of  operation  i  is  The 

objective  is  to  minimize  total  completion  time,  subject  to  (i)  precedence  con¬ 
straints  between  the  operations,  and  (ii)  the  condition  that  a  machine  can 
process  only  one  item  at  a  time,  and  operations  cannot  be  interrupted.  The 
problem  is  usually  stated  [1]  as 

min  t 

n 

‘j  •  Ci*di’ 

(P)  ti  >  °> 

t  -  t  >  d.  V  t.  -  t,  >  d.  ,  (i, j)  e  W 

j  i-L  i  J  “  J 

where  t^  is  the  starting  time  of  job  i  (with  n  the  dummy  job  "finish"), 

V  is  the  set  of  operations,  Z  the  set  of  pairs  constrained  by  precedence 
relations,  and  W+  the  set  of  pairs  that  use  the  same  machine  and  therefore 
cannot  overlap  in  time.  It  is  often  useful  to  represent  the  problem  by  a 


(i , j)  e  Z 
i  e  V 


disjunctive  graph  G  =  (V,  Z,  W),  with  vertex  set  V  and  two  kinds  of  directed 
arc  sets:  conjunctive  (or  usual)  arcs,  indexed  by  Z,  and  disjunctive  arcs, 
indexed  by  W.  The  set  W  consists  of  pairs  of  disjunctive  arcs  and  is  of 
the  form  W  =  W+UW  ,  with  (i,j)eW+  if  and  only  if  (j,i)eW~.  The  subset 
of  nodes  corresponding  to  each  machine,  together  with  the  disjunctive  arcs 

joining  them  to  each  other,  forms  a  disjunctive  clique.  A  selection  Sew 

q 

consists  of  exactly  one  member  of  each  pair  of  W:  i.e.,  there  are  2 
possible  selections,  where  q  =  j|w| :  G  is  illustrated  in  Fig.  5.1,  where  the 
disjunctive  arcs  are  shown  by  dotted  lines.  If  3  denotes  the  set  of  selections, 
for  every  S  eS,  Gs  =  (V,  ZUS)  is  an  ordinary  directed  graph;  and  the  prob¬ 
lem  (P(S))  obtained  from  (?)  by  replacing  the  set  of  disjunctive  constraints 
indexed  by  W+  with  the  set  of  conjunctive  constraints  indexed  by  S  is  the 
dual  of  a  longest  path  (critical  path)  problem  in  Gg.  Thus  solving  (P) 
amounts  to  finding  a  selection  S  that  minimizes  the  length  of  a  critical 
path  in  G,.. 


The  usual  mixed  integer  programming  formulation  of  (P)  represents 
each  disjunction 

(5.1)  t.  -  t  >  d,  v  t.  -  t  >  d 
J  i  i  i  j  -  j 


by  the  constraint  set 
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Cj  '  ti  "  (di  '  Lij)ylj  -  Lij 


(5.2) 


•t.  +  tt  +  (dj  -  Ljt)yiJ  >  d 


where  L. .  is  a  lower  bound  on  t.  -  t  .  Unless  one  wants  to  use  a  very 

ij  j  i  7 

crude  lower  bound  L^,  one  has  to  derive  lower  and  upper  bounds,  and 
Uk,  respectively,  on  each  t^,  ieV,  and  set  -  U^.  can  be  taken 

to  be  the  length  of  a  longest  path  from  node  1  (the  source)  to  node  j  In  the 

(conjunctive)  graph  *  (V,  Z),  and  the  difference  between  the  length 
of  a  critical  path  in  Gg  for  some  arbitrary  selection  S  *5,  and  the  length 
of  a  longest  path  from  node  j  to  node  n  (the  sink)  in  G^. 

The  constraint  set  (5.2)  accurately  represents  (5.1)  (amended  with 
the  bounds  <  tfe  <  Ufc,  k  =  1,2),  but  its  linear  programming  relaxation 

(5.2) l,  obtained  by  replacing  y^e{0,l}  by  0  <  y  <  1,  has  no  constraining 
power,  as  shown  by  the  next  theorem. 

Theorem  5.1.  If  the  disjunction  (5.1)  is  proper,  then  every  t^,  t^ 
that  satisfies 

(5.3)  Lt  <  tt  <  Ut  ,  Lj  <  tj  <  U 
also  satisfies  (5.2)^. 

Proof.  It  suffices  to  show  that  the  four  extreme  points  (L^,  L^), 
(L^,  Uj)f  (U^»  L.),  Uj)  of  the  two-dimensional  box  defined  by  (5.3) 

satisfy  (5,2)  for  some  y...  We  first  write  (5.2).  in  the  form 

L  1 J  L 


(5.2)l  (Lj  -  Ut)(l  -  ytj)  +  d^  <  tj  -  tt  <-d5(l  -  ytJ)  +  (Uj  -  L^y. 


0  <  yij  <  1 


and  note  that  (L. ,  U.)  and  (L.,  U.)  satisfy  (5,2)  for  y. .  =  1  and  y. .  =  0, 
l  J  J  i  ij  ij 

respectively.  To  show  that  (L,  ,  L.)  satisfies  (5.2)  for  some  y..,  we 

i  J  L  ij 

substitute  (L^,  L^)  into  (5.2)^  and  obtain 


d.-L.+L.  U.-L. 

(5  4)  J  1  1  <  y  <  -±—L 

1  * }  d.-L.-HJ.  -  7ii  -  U.-L.+ 

j  l  j  1J  11 


U.-L.+d.  » 

i  J  i 


To  see  that  (5.4)  is  feasible,  note  that  the  right  hand  side  increases 
with  IL  ;  so  (5.4)  is  feasible  if  it  is  for  the  smallest  admissible  value  of 
U.  ,  which  is  +  d^  (for  smaller  (5.1)  becomes  improper).  Substituting 
L.  +  d.  for  U.  we  obtain  that  (5.2)  is  feasible  whenever  L.  +  d.  <  U., 

j  j  l  l  l  -  j 

which  is  a  condition  for  (5.1)  to  be  proper. 

An  analogous  argument  shows  that  (U. ,  U.)  satisfies  (5.2)  for  some 

7ij*'' 

Consider  now  the  mixed  integer  representation  of  (5.1)  associated 

with  the  hull-relaxation  of  the  feasible  set  of  (P).  If  the  latter  is 

given  in  CNF,  as  is  usually  the  case,  applying  the  hull-relaxation  to  this 

form  yields  nothing,  since  the  convex  hull  of  the  disjunctive  set  defined 
2 

by  (5.1)  is  B.  ,  the  space  of  (t^,  t^).  If  we  perform  a  parallel  basic 
step  of  the  type  defined  in  section  3  and  introduce  into  each  disjunct  of 
(5.1)  the  lower  and  upper  bounds  on  t^  and  t^ ,  this  replaces  every  elementary 
disjunctive  set  defined  by  a  pair  of  constraints  (5.1),  by  a  disjunctive 


“  t *  >  d. \ 

/  t.  -  t,  >  d 

\ 

f  i  j  "  j 

c  t,  <  u.  v 

L,  <  t,  <  U, 

—  i  -  i 

i  —  i  —  i 

<  t.  <  u.  / 

\  L.  <  t.  <  U. 

-  J  -  J'  '  J  -  j  -  j 

The  feasible  set  of  (P)  is  then  of  the  form 


(5.7) 


F  =  P  C{  ,  i 

°  \i,j)eW+ 


where  Pq  is  the  polyhedron  defined  by  the  inequalities  (5.3)  and  ^  >  d 

(ifj)s  Z,  Further,  we  have  (since  all  S.  .  are  bounded,  clconv  S  .  ■  conv  S 

i-J  i-J  ij 

h-rel  F  *  P  fl(  f  'S  conv  S,  . 

°  \i,J)€W+ 

and  from  Theorem  3.3,  the  convex  hull  of  S..  is  the  set  of  those  (t,,t.) 

ij  i*  y 

satisfying  the  constraints 


Ck  "  Ck  “  Ck  =  0  »  k  “  i»i 


CJ  -  '1  2  Vli 

'  'j  +  ci  2  dj (1  "  yij> 


(5.8) 


k  =  i,  j 


VlJ  ^  \  <  Vlj 


V1  -  V  ^  \  $  V1  '  V 


0  <  7tj  <  i 


Also,  from  Corollary  3.7,  the  set  of  those  (t^,tj)  satisfying 
(5.8)  and  y^^e{0,l}  is  ,  since  both  disjuncts  of  are  bounded 
polyhedra;  and  thus  using  (5.8)  with  y^e{0,l}  for  all  (i,j)eW^  is  a 
valid  mixed  integer  formulation  of  (P).  This  representation  uses  the 


same  number  of  0-1  variables  as  the  usual  one,  but  introduces  two  new 
1  2 

variables,  t^,  t^»  for  every  original  variable  t^,  with  associated  bounding 
inequalities  L^y  <  t£  <  Uky  ,  1^(1  -  y  )  <  tj  <  Ufc(l  -  y^).  At  the 
price  of  this  increase  in  the  number  of  variables  and  constraints,  one 


3. 


obtains  as  the  hull-relaxation  a  linear  program  whose  feasible  set  is 


considerably  tighter  than  in  the  usual  formulations  since  each  constraint 
set  (5.8)  defines  the  convex  hull  of  S^.  It  is  not  hard  to  see  that  each 
of  the  two  points  (L^,  L^)  and  (U^,  IL)  violates  (5.8)  unless  it  is  con¬ 
tained  in  one  of  the  two  halfspaces  defined  by  t.  -  t  >  d  and  t  -  t  > 

j  i  -  i  x  j  - 

Let  us  now  perform  some  further  basic  steps  on  the  regular  form  (5.7) 
before  taking  the  hull-relaxation.  In  particular,  let  us  intersect  all 
such  that  i  and  j  belong  to  the  same  disjunctive  clique  K.  If  we  denote 
T (K) :  =  n(S.j:  i,  jeK,  i*j),  and  if  \k\  =  p,  then 


T(K)  =  )  teR 


t.  -  t.  >  d  V  t.  -  t.  >  d. ,  i,  jeK,  i£j 
1  J  J  J  i-i 


L.  <  t.  <  U. ,  icK 

i-i-i 


Taking  the  basic  steps  in  question  consists  of  putting  T(K)  in 

disjunctive  normal  form.  Let  <  K  >  denote  the  subgraph  of  G  induced  by 

K,  i.e.,  the  disjunctive  clique  with  node  set  K.  A  selection  in  <  K  >, 

as  defined  at  the  beginning  of  this  section,  is  a  set  of  arcs  containing 

one  member  of  each  disjunctive  pair.  Thus  if  <  K  >  is  viewed  simply  as 

the  complete  digraph  on  K,  then  a  selection  is  the  same  thing  as  a 

tournament  in  <  K  >.  If  S,  denotes  the  k-th  selection  in  <  K  >  and  Q 

indexes  the  selections  of  <  K  >,  then  the  DNF  of  T(K)  is  T(K)  =  U  T.(K), 

keQ 

where 


t.  -  t,  >  d.,  (i,j)  eS, 


L.  <  t.  <  U. ,  ieK 


Tk(K)  =  <  tell* 
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It  is  easy  Co  see  that  if  contains  a  cycle,  then  T^(K)  =*  0. 

Let  Q  =  fkeQ|S^  is  acyclic}.  Every  selection  is  known  to  contain  a 
directed  Hamilton  path,  and  for  acyclic  selections  this  path  must  be 
unique.  Furthermore,  every  acyclic  selection  is  the  transitive  closure 
of  its  unique  directed  Hamilton  path. 

Let  denote  the  directed  Hamilton  path  of  the  acyclic  selection 
;  then  is  the  transitive  closure  of  P^»  and  the  inequalities 
t.  -  t.  >d.  ,  (i,j)  e  P.,  obviously  imply  the  remaining  inequalities  of 

J  1.  “ *  X  tC 

T^(K) ,  corresponding  to  arcs  (i,j)  e  S^\P^.  Thus  a  more  economical  ex¬ 
pression  for  the  DNF  of  T  is  T(K)  =  U  1.  (K),  with 

keQ* 


VK)  =  < 


f 

\ 

tj  -  tt  >iv  d,j)  epk 

<  te]RP 

> 

L.  <  t.  <  U, ,  ieK 

V 

x  ~  x  -  i 

/ 

Now  let  M  be  the  index  set  of  the  disjunctive  cliques  in  G,  and  K 

m 

the  node  set  of  the  m-th  such  clique.  Then  the  RF  obtained  from  (5.7) 
by  performing  the  basic  steps  described  above  is 


(5.9)  F  =  P  n  (  O  T(K  )), 

meM 


and  the  hull -relaxation  of  this  form  is 


(5.10)  h-rel  F  =  P  0  ( O  conv  T(K  )). 

o  '  m 

meM 


m 


For  meM,  let  Q*  index  the  acyclic  selections  in  <  K  >;  and  for 
keQ*,  let  S®  and  P™  denote  the  k-th  acyclic  selection  in  <  K  >,  and  its 

ni  &  tc  m 

directed  Hamilton  path,  respectively.  Then  introducing  a  continuous 
variable  X.”  for  every  acyclic  selection  S°  and  a  0-1  variable  y  for 
every  disjunctive  pair  of  arcs  £(i,j),  (j,i)},  and  using  Theorem  4.4, 
we  obtain  the  following  mixed  integer  formulation  of  problem  (P)  based 
on  the  hull -relaxation  (5.10). 


min  t 


t .  -  t. 
J  i 


>  dj  (i,j)eZ 


t . 
J 


-  S  ck 


'’■‘K  3 

k 


=  0 


jeR  ,  meM 
m 


Ic 

*  Cj(l,k)  +  C j (2 ,k) 


dj(l,k)Xk 


>  0 


tk 


>  keQ£,  meM 


j(p  -l,k)  +  tj(p,  ,k)  '  dj(p. -l,k) 


m 


>  0 


Ck 

j(l,k) 


-  t 


j(Pk»k) 


+  03.,  ,  ,-L.  „  ,  .  )X®  >0  ' 

j(Pk»k>  J (1 »k)  k- 


m 


meM 


I 


m 


_  \  +  y  *1 

k|<i,j)eS.  k  « 


(i, j)eW 


z 


X.m  -  y  —  0 

k  i  j 


k[  (j,i)eS. 


tj’  Cj  -  °»  V  j’k;  Xk  ^  °»  v  k>®5  y^eCo,!},  (i,j)eW+  . 


Theorem  5.2«  Problem  (P)  is  equivalent  to  (P):  if  t  is  a  feasible 


solution  to  (P) ,  there  exist  vectors  t  and  scalars  X~,  keQ*>  meM,  and  a 

k  m 


k 


vector  y,  satisfying  the  constraints  of  (P) ;  and  conversely,  if  t,  t  ,  ^ 


keQ  ,  meM,  and  y  satisfy  the  constraints  of  (P),  then  t  is  a  feasible 
m 


solution  to  (P) , 


Proof.  (P)  is  the  representation  of  (P)  given  in  Theorem  4.4,  with 
the  set  F.  replaced  by  F  as  defined  in  (5.9),  and  with  the  difference  that 
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tc 

the  upper  bounding  inequalities  -  t.  +U.  \,  >  0,  jeK  ,  are  replaced  by 

J  j  ic  in 

Che  inequality  !*(l>k)  -  +  (Oj(p^k)  -  LJ(1>k)»k  >  0. 

The  role  of  the  upper  bounding  inequalities  is  to  force  each  t  ^  to  0  when 
\™  =  0,  and  the  inequality  that  replaces  them  in  P  does  precisely  that: 


together  with  the  inequalities  associated  with  the  arcs  of  P™,  it  defines 

a  directed  cycle  in  <  K  >  and  thus  »  0  forces  to  0  all  t1?  jeK  . !! 

m  k  j  ’  J  m  11 


The  linear  programming  relaxation  of  (P)  is  much  stronger  than  the 
linear  programming  relaxation  of  the  common  mixed  integer  formulation  of  (P) 
Preliminary  computational  experience  on  a  few  small  problems  indicates  that 
the  value  of  this  stronger  linear  programming  relaxation  tends  to  be  much 
higher  than  that  of  the  usual  linear  programming  relaxation.  For  example: 


Value  of 

Usual  LP 

Strong  LP 

IP 

Problem  1 

18 

25.1 

31 

Problem  2 

8 

10.7 

13 

Problem  3 

20 

25.8 
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On  the  other  hand  the  linear  programming  relaxation  of  (P) ,  unlike 
that  of  the  usual  mixed  integer  formulation  of  (P),  is  not  a  longest  path 
problem.  This  is  a  serious  disadvantage,  which  has  to  be  overcome  by 
finding  a  solution  method  that  takes  advantage  of  the  structure  of  (P). 
While  this  is  in  general  still  an  unsolved  problem,  an  important 
aspect  of  it  has  been  successfully  solved.  Namely,  if  (P)  is  to  be 
solved  by  projection  on  the  space  of  the  y-variables,  i.e.,  by  Benders's 
partitioning  method,  then  in  order  to  generate  the  inequalities  of  the 
Benders  master  problem  one  has  to  solve  the  dual  of  the  linear  program 
obtained  from  (P)  fof  various  0-1  values  of  y.  We  have  recently  found  a 
way  of  deriving  a  solution  to  this  problem  from  a  solution  to  the  longest 


path  problem  that  corresponds  to  it  in  the  usual  formulation  of  (p).  But 
the  discussion  of  this  algorithm  is  left  to  another  paper. 
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We  discuss  a  new  conceptual  framework  for  the  convexif ication  of  discrete 
optimization  problems,  and  a  general  technique  for  obtaining  approximations 
to  the  convex  hull  of  the  feasible  set.  The  concepts  come  from  disjunctive 
programming  and  the  key  tool  is  a  description  of  the  convex  hull  of  a  union 
of  polyhedra  in  terms  of  a  higher  dimensional  polyhedron.  Although  this 
description  was  known  for  several  years,  only  recently  was  it  shown  by 
Jeroslow  and  Lowe  to  yield  improved  representations  of  discrete  optimization 
problems.  We  express  the  feas 
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the  intersection  (conjunction)  of  unions  of  polyhedra,  and  define  an 
operation  that  takes  one  such  expression  into  another,  equivalent  one, 
with  fewer  conjuncts.  We  then  introduce  a  class  of  relaxations  based 
on  replacing  each  conjunct  (union  of  polyhedra)  by  its  convex  hull. 

The  strength  of  the  relaxations  increases  as  the  number  of  conjuncts 
decreases,  and  the  class  of  relaxations  forms  a  hierarchy  that  spans 
the  spectrum  between  the  common  linear  programming  relaxation,  and 
the  convex  hull  of  the  feasible  set  itself.  Instances  where  this 
approach  presents  advantages  include  critical  path  problems  in  dis¬ 
junctive  graphs,  network  synthesis  problems,  certain  fixed  charge 
network  flow  problems,  etc.  We  illustrate  the  approach  on  the  first 
of  these  problems,  which  is  a  model  for  machine  sequencing. 


